In this paper, we discuss guidelines for a reward design problem that defines when and what amount of reward should be given to the agent/s, within the context of reinforcement learning approach. We would like to take keepaway soccer as a standard task of the multiagent domain which requires skilled teamwork. The difficulties of designing reward for this task are due to its features as follows: i) since it belongs to the continuing task which has no explicit goal to achieve, (...) it is hard to tell when reward should be given to the agent/s. ii) since it is a multiagent cooperative task, it is hard to decide what is a fair share of reward for each agent's contribution to achieve the goal. Through some experiments, we show that the reward design have a major effect on the agent's behavior, and introduce the successful reward function that makes agents perform keepaway better and more interesting than the conventional one does. Finally, we explore the relationship between `reward design' and `acquired behaviors' from the viewpoint of teamwork. (shrink)

By RCA 0 , we denote a subsystem of second order arithmetic based on Δ0 1 comprehension and Δ0 1 induction. We show within this system that the real number system R satisfies all the theorems (possibly with non-standard length) of the theory of real closed fields under an appropriate truth definition. This enables us to develop linear algebra and polynomial ring theory over real and complex numbers, so that we particularly obtain Hilbert’s Nullstellensatz in RCA 0.

In this paper, we show within ${\mathsf{RCA}_0}$ that both the Jordan curve theorem and the Schönflies theorem are equivalent to weak König’s lemma. Within ${\mathsf {WKL}_0}$ , we prove the Jordan curve theorem using an argument of non-standard analysis based on the fact that every countable non-standard model of ${\mathsf {WKL}_0}$ has a proper initial part that is isomorphic to itself (Tanaka in Math Logic Q 43:396–400, 1997).

This paper deals with a proof theory for a theory T3 of Π3-reflecting ordinals using the system O of ordinal diagrams in Arai 1375). This is a sequel to the previous one 1) in which a theory for recursively Mahlo ordinals is analyzed proof-theoretically.

In this paper, we discuss uniform versions of some axioms of second order arithmetic in the context of higher order arithmetic. We prove that uniform versions of weak weak König's lemma WWKL and Σ01 separation are equivalent to over a suitable base theory of higher order arithmetic, where is the assertion that there exists Φ2 such that Φf1 = 0 if and only if ∃x0 for all f. We also prove that uniform versions of some well-known theorems are equivalent to (...) or the axiom of the existence of the Suslin operator. (shrink)

The emotions that people experience in day-to-day social situations are often mixed emotions. Although autobiographical recall is useful as an emotion induction procedure, it often involves recalling memories associated with a specific discrete emotion. However, real-life emotions occur freely and spontaneously, without such constraints. To understand real-life emotions, the present study examined characteristics of emotions that were elicited by recalling “stressful interpersonal events in daily life” without the targeted evocation of a specific discrete emotion. Assuming generation of mixed and complex (...) emotions, emotional groups with relatively strong correlation of multiple emotions according to surprise, fear, anger, disgust, sadness, and happiness were expected. Seventy-two university students participated in the study. In the emotion induction procedure, participants freely recalled memories as per the instructions on a monitor, and then responded silently to a series of questions concerning any one recalled incident. Assessments of emotional states using emotion scales and another item indicated that validated emotional changes had occurred during the task. Inter-correlations between six emotions demonstrated an emotional group consisting of disgust and anger, which frequently occur as negative interpersonal feelings, and that of fear and sadness. This indicated generation of mixed and complex emotions as experienced in social life. Future studies concerning relationships between these emotions and other factors, including neurophysiological responses, may facilitate further understanding about relationships between mental and physiological processes occurring in daily life. (shrink)

BackgroundRegulations on forgoing life-sustaining treatment (LST) have developed in Asian countries including Japan, Korea and Taiwan. However, other countries are relatively unaware of these due to the language barrier. This article aims to describe and compare the relevant regulatory frameworks, using the (more familiar) situation in England as a point of reference. We undertook literature reviews to ascertain the legal and regulatory positions on forgoing LST in Japan, Korea, Taiwan, and England.Main textFindings from a literature review are first presented to (...) describe the development of the regulatory frameworks surrounding the option of forgoing LST in each country. Based on the findings from the four countries, we suggest five ethically important points, reflection on which should help to inform the further development of regulatory frameworks concerning end-of-life care in these countries and beyond. There should be reflection on: (1) the definition of – and reasons for defining – the ‘terminal stage’ and associated criteria for making such judgements; Korea and Taiwan limit forgoing LST to patients in this stage, but there are risks associated with defining this too narrowly or broadly; (2) foregoing LST for patients who arenotin this stage, as is allowed in Japan and England, because here too there are areas of controversy, including (in England) whether the law in this area does enough to respect the autonomy of (now) incapacitated patients; (3) whether ‘foregoing’ LST should encompass withholdingandwithdrawing treatment; this is also an ethically disputed area, particularly in the Asian countries we examine; (4) the family’s role in end-of-life decision-making, particularly as, compared with England, the three Asian countries traditionally place a greater emphasis on families and communities than on individuals; and (5) decision-making with and for those incapacitated patients who lack families, surrogate decision-makers or ADs.ConclusionComparison of, and reflection on, the different legal positions that obtain in Japan, Korea, Taiwan, and England should prove informative and we particularly invite reflection on five areas, in the hope the ensuing discussions will help to establish better end-of-life regulatory frameworks in these countries and elsewhere. (shrink)

In this paper we introduce a recursive notation system O(Π 3 ) of ordinals. An element of the notation system is called an ordinal diagram. The system is designed for proof theoretic study of theories of Π 3 -reflection. We show that for each $\alpha in O(Π 3 ) a set theory KP Π 3 for Π 3 -reflection proves that the initial segment of O(Π 3 ) determined by α is a well ordering. Proof theoretic study for such theories (...) will be reported in [4]. (shrink)

In this paper we show that the intuitionistic fixed point theory FiXi over set theories T is a conservative extension of T if T can manipulate finite sequences and has the full foundation schema.

Background There are several psychosocial and ethical issues surrounding the decision to be a living kidney donor. The present study aimed to determine the perceptions of psychosocial and ethical issues that living kidney donors may have, and analyze their psychological characteristics.Methods Face-to-face semi-structured interviews were conducted with 15 donors. Thematic analysis was then performed to categorize the thematic elements of the transcripts. All procedures were approved by the relevant review board.Results Four main categories were identified: Awareness of family dynamics, barriers (...) to a proper understanding, contrasting psychological effects of recipient presence in clinical practice, insufficient information explained in informed consent.Conclusion Donors felt that they took on the “role as a care giver” for the recipient and were less aware of themselves as patients. This is a new concept that has not been shown in previous studies. Donors exist within the recipient and family, and the range of their autonomy may go beyond the traditional concept of autonomy and be rooted in relational autonomy. This study suggested that medical treatment in the presence of the recipient promotes the relational autonomy of the donor. (shrink)

In Japan, although many people are interested in corporate governance and business ethics, there is little consensus on what good corporate governance entails. The Japanese Commercial Code (revised in 2003) enables Japanese companies to introduce a board committee system and abolish the company auditor system. After the recent exposure of various corporate malpractices, many Japanese companies have started institutionalizing business ethics in their organizations. Nevertheless, ethical issues such as death from overwork (karoshi), harassment at work, illegal collusion (dangou), and defrauding (...) consumers and governments still remain prominent. (shrink)

In this note the well-ordering principle for the derivative \ of normal functions \ on ordinals is shown to be equivalent to the existence of arbitrarily large countable coded \-models of the well-ordering principle for the function \.

In this paper, we prove the wellfoundedness of recursive notation systems for reflecting ordinals up to Π₃-reflection by relevant inductive definitions.

Priest holds anti-exceptionalism about logic. That is, he holds that logic, as a theory, does not have any exceptional status in relation to the theories of empirical sciences. Crucial to Priest’s anti-exceptionalism is the existence of ‘data’ that can force the revision of logical theory. He claims that classical logic is inadequate to the available data and, thus, needs to be revised. But what kind of data can overturn classical logic? Priest claims that the data is our intuitions about the (...) validity of inferences. In order to make sense of this claim, I will appeal to the Madhyamaka Buddhist philosopher Candrakīrti. I will then pose a problem for Priest’s anti-exceptionalism. Finally, I will suggest a way out of the problem for Priest. Whether or not he accepts my solution, I will let him decide. (shrink)

Hilbert proposed the epsilon substitution method as a basis for consistency proofs. Hilbert's Ansatz for finding a solving substitution for any given finite set of transfinite axioms is, starting with the null substitution S0, to correct false values step by step and thereby generate the process S0,S1,… . The problem is to show that the approximating process terminates. After Gentzen's innovation, Ackermann 162) succeeded to prove termination of the process for first order arithmetic. Inspired by G. Mints as an Ariadne's (...) thread we formulate the epsilon substitution method for the theory ID1 of non-iterated inductive definitions for disjunctions of simply universal and existential operators, and give a termination proof of the H-process based on Ackermann 162). The termination proof is based on transfinite induction up to the Howard ordinal. (shrink)

This article extends the concept of symmetry to ethics. Using the case of canola in Canada, the authors argue that grades and standards simultaneously subject humans and nonhumans to rites of passage that test their "goodness. " Then, they further develop a tentative typology of standards. The authors argue that these standards allow something resembling the neoclassical market to be established, create the conditions for economic analysis, and allocate power among human actors.

A logic is said to be paraconsistent if it doesn’t license you to infer everything from a contradiction. To be precise, let |= be a relation of logical consequence. We call |= explosive if it validates the inference rule: {A,¬A} |= B for every A and B. Classical logic and most other standard logics, including intuitionist logic, are explosive. Instead of licensing you to infer everything from a contradiction, paraconsistent logic allows you to sensibly deal with the contradiction.

Following our [6], though with somewhat different methods here, further variants of Goodstein sequences are introduced in terms of parameterized Ackermann–Péter functions. Each of the sequences is shown to terminate, and the proof-theoretic strengths of these facts are calibrated by means of ordinal assignments, yielding independence results for a range of theories: PRA, PA,$\Sigma ^1_1$-DC$_0$, ATR$_0$, up to ID$_1$. The key is the so-called “Hardy hierarchy” of proof-theoretic bounding finctions, providing a uniform method for associating Goodstein-type sequences with parameterized normal (...) form representations of positive integers. (shrink)

We formulate epsilon substitution method for theories (H)α0 of absolute jump hierarchies, and give two termination proofs of the H-process: The first proof is an adaption of Mints M, Mints-Tupailo-Buchholz MTB, i.e., based on a cut-elimination of a specially devised infinitary calculus. The second one is an adaption of Ackermann Ack. Each termination proof is based on transfinite induction up to an ordinal θ(α0+ ω)0, which is best possible.

We gather the following miscellaneous results in proof theory from the attic.1. 1. A provably well-founded elementary ordering admits an elementary order preserving map.2. 2. A simple proof of an elementary bound for cut elimination in propositional calculus and its applications to separation problem in relativized bounded arithmetic below S21.3. 3. Equivalents for Bar Induction, e.g., reflection schema for ω logic.4. 4. Direct computations in an equational calculus PRE and a decidability problem for provable inequations in PRE.5. 5. Intuitionistic fixed (...) point theories which are conservative extensions of HA.6. 6. Proof theoretic strengths of classical fixed points theories.7. 7. An equivalence between transfinite induction rule and iterated reflection schema over IΣn.8. 8. Derivation lengths of finite rewrite rules reducing under lexicographic path orders and multiply recursive functions.Each section can be read separately in principle. (shrink)

In this paper we show that the intuitionistic theory for finitely many iterations of strictly positive operators is a conservative extension of Heyting arithmetic. The proof is inspired by the quick cut-elimination due to G. Mints. This technique is also applied to fragments of Heyting arithmetic.

Book Information The Blackwell Guide to Philosophical Logic. Edited by Lou Goble. Blackwell Publishers. Oxford. 2001. Pp. x + 510. Paperback, £16.99.

Inspired from a joint work by A. Beckmann, S. Buss and S. Friedman, we propose a class of set-theoretic functions, predicatively computable set functions. Each function in this class is polynomial time computable when we restrict to finite binary strings.

In Arai (An ordinal analysis of a single stable ordinal, submitted) it is shown that an ordinal \(\sup _{N is an upper bound for the proof-theoretic ordinal of a set theory \(\mathsf {KP}\ell ^{r}+(M\prec _{\Sigma _{1}}V)\). In this paper we show that a second order arithmetic \(\Sigma ^{1-}_{2}{\mathrm {-CA}}+\Pi ^{1}_{1}{\mathrm {-CA}}_{0}\) proves the wellfoundedness up to \(\psi _{\varOmega _{1}}(\varepsilon _{\varOmega _{{\mathbb {S}}+N+1}})\) for each _N_. It is easy to interpret \(\Sigma ^{1-}_{2}{\mathrm {-CA}}+\Pi ^{1}_{1}{\mathrm {-CA}}_{0}\) in \(\mathsf {KP}\ell ^{r}+(M\prec _{\Sigma (...) _{1}}V)\). (shrink)

Companies have a moral responsibility to treat customers fairly. One way for companies to do so is to allow their employees to exercise reasonableness in their interactions with customers. We define reasonableness as a latitude or space that exists around expectations in the delivery of service. In this paper, we explore the concept of reasonableness from a customer’s perspective (i.e., perceived reasonableness) and the role that the morals of service personnel play in customers’ perceptions of reasonableness. First, through an open-ended (...) survey on customers’ unreasonable service experiences, we identify themes of perceived reasonableness. We also discuss the role that the morals of service personnel play within these themes. Second, in order to identify the relationships between these themes, we create a cognitive map and discuss the implications of the identified relationships. Finally, we provide directions for future research on reasonableness. (shrink)

ABSTRACTThreat detection is crucial to survival. Studies using unnatural visual scene settings have shown that humans and primates are able to identify snakes more quickl...